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1 6  Abstract 

Reviews  have  cons^tendy  concluded  that  the  validity  of  personality  a.s  a  predictor  of  job  performance  is  low  (Besco.  1991;  Reilly  &  Cihao.  1982; 
Tenopyr  &  Oeltjen,  1982).  However,  Barrick  and  Mount's  (1991)  meta-analysis  of  studies  of  personality  and  job  performance  demonstrated 
the  utility  of  the  Big  Five"  model  of  personality  (Pigman,  1990)  in  personnel  selection  and  training.  1  his  siudv  was  designed  to  evaluate  the 
utility  of  personality  in  predicting  student  success  in  the  FAA’s  Air  TrafFic  Control  .Specialist  (.ATtlS)  Nonradar  Screen  Program  ("the 
Screen").  The  .Screen  follows  the  miniature  training,  testing,  and  evaluation  paradigm  (Siegel,  1983).  in  which  individuals  with  no  prior 
knowledge  of  the  occupation  are  taught  cri'ical  aspect.s  of  the  job  and  then  assessed  on  a  pass/fail  basis  for  their  potential  to  succeed  as 
controllers.  T  he  NEO  Persanality  Inventory  Costa  &  McCrae,  198S)  was  administered  to  723  men  and  30''  women  at  entry  into 

the  9-week  .Screen.  NEO-Pl  scale  scores  and  cognitive  aptitude  measures  were  used  to  predict  final  composite  scores  (COMP)  of  students. 
Men  and  women  air  trafific  students  exhibited  lower  average  scores  in  Eleurotidsm,  liigher  average  scores  in  Extroversion,  Openness  to 
Experience,  and  Conscientiousness,  and  no  difference  on  Agreeahleness  when  compared  to  normative  samples.  Correlations  between  the 
personality  scales  and  COMP  were  low  for  both  sexes,  ranging  from  .000  with  Impubii  eness.  a  facet  of  Neuroticism,  to  -.148  with  Excitement- 
seeking.  3  facet  of  the  Extraversion  dimension.  Despite  the  low  zero-order  correlations,  several  of  the  pcrsonalitv  facets  proved  useful  in  a 
regression  equation,  explaining  an  additional  3%  of  variance  in  performance  over  that  explained  by  cognitive  aptitude  measures  These 
included  Excitement-seeking.  Fantasy,  Activity,  and  /</eas.  While  these  results  were  not  entirely  consistent  with  Barrick  and  Mount  (1991).  they 
do  offer  some  support  for  the  role  of  personality  variables  in  th:  prcdiciiou  of  s'.;ccc.,s  in  the  ATC.S  .Screen.  Continued  research  is  needed  to 
assess  the  relationship  of  theoretically-based  measures  of  personality  to  success  on  the  job  over  time. 
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Contribution  of  Personali  i^y  lo  the  Predici  ion  of  Succt^ss  in 
Initial  Air  Traffic  Control  Specialls  i  Training 


The  genera!  public  and  the  news  media  often  ascribe 
personality  characteristics  to  individuals  in  certain  occu¬ 
pations.  For  example,  the  air  traffic  control  specialist 
{A’l  CiS)  occupation  is  sometimes  described  in  terms  of 
personality  traits  such  as  “stress  tolerant”  and  “attentive 
to  detail.”  This  ascription  is  sometimes  extended  to 
suggest  that  individu.  Is  vdth  certain  personality  charac¬ 
teristics  are  attracted  to  specific  occupations.  Sonic  re¬ 
search  findings,  such  as  that  of  Kassera  and  Russo  ( 1 987), 
provide  scientific  support  to  this  lay  notion  of  conver¬ 
gence  between  personality  and  occupation.  Personality 
is  also  cited  as  an  explanation  for  occupational  perfor¬ 
mance.  For  example,  in  a  review  of  cognitive  and 
noncognitivc  factors  associated  with  A1  C7S  performance, 
dolman  (1970,  p.  47)  noted  that  the  “importance  of 
personality,  interest,  and  motivation  in  successful  per¬ 
formance  of  air  traffic  control  work  is  recognized  not 
only  by  the  mental  health  staff  of  the  agency,  but  by 
working  controllers,  supervisors,  personnel  and  general 
medical  specialists  as  well.”  This  view  that  personality  is 
related  to  occupational  choice  and  performance  suggests 
fsvo  basic  research  questions;  (a)  do  persons  who  enter 
the  ATCS  occupation  differ  from  the  general  public  with 
respect  to  general  personality  characteristics;  and  (b) 
what  personality  characteristics,  if  any,  predict  who  is 
likely  to  become  a  succe.ssful  controller? 

pREViou.s  Research 

Differences  Between  Controllers  and  General 
Population 

Previous  research  is  mixed  on  the  question  of  personality 
differences  between  controllers  and  the  general  popula¬ 
tion.  On  one  hand,  Karsonand  O’Dell  (1974)  compared 
controllers  {N^  =  11,074)  and  the  genera!  population 
using  CiattelFs  I6PF.  While  most  of  the  comparisons 
were  statistically  significant,  the  differences  of  practical 
significance  indicated  tnat  controllers  were,  on  the  aver¬ 
age,  brighter  (B).  more  conforming  to  the  g;oUp  (u}, 
tough  minded  (/),  practical  (Af),  .self-di.sciplincd  {Q.i), 
and  less  suspicious  (/,)  than  the  normative  16PF  sample. 
Rose,  Jenkins,  and  Hurst  (1978)  reported  that  results 
from  administration  of  the  1 6PF  to  their  sample  of  388 


controllers  were  highly  similar  to  those  noted  bv  Karson 
and  O'Dell.  About  13  years  later.  Schroeder  and  Dollar 
{ 1 989)  found  evidence  of  the  same  general  !  IjPF  profile 
for  controllers  as  Karson  and  O'Dell  and  Rose,  et  ai. 
Hosvever,  the  1984  applicant  group  (N  -  3,468)  also 
reported  less  insecurity  ( O),  less  tension  ( Q  f).  and  greater 
self-assertivencss  (/f).  self-discipline  (Q.F),  and  emotional 
stability  {(')  than  the  19“4  controller  group.  Simil.irlv 
Deloncy  and  Schroeder  (1984)  found  differences  be¬ 
tween  entry  level  coniroliers  (,V=  4.244)  enrolled  in  the 
FAA  Academy  and  individuals  in  college  or  other  occu¬ 
pational  settings,  using  the  Myers-Brij^^  Type  Indicator 
(AfBTh  Myers,  1 962).  Fhcre  were  higher  percentages  of 
controllers  classified  as  Scnsiri^-  Thinkin^-fudi^ing  iJS'TJ 
&  ESTfi  than  among  other  groups. 

On  the  other  hand.  Rose,  Jenkins,  and  Hurst  (19“’8) 
found  little  difference  between  controller  scores  (A'  = 
391 )  and  population  norms  on  the  ('alifoniia  Perfonaltty 
ImrntoryiCPh  Gough,  1960).  In  that  study,  controllers 
were  lower  on  Socialization  ttnd  Respontihility  \(.a.\ct>  than 
the  normative  group,  and  low  average  on  Self-control,  but 
were  still  within  normal  limits.  Air  traffic  controllers  in 
the  field,  as  well  as  in  the  Academy  classroom,  have  also 
been  consistently  reported  as  having  lower  levels  of  trait 
anxiety  than  indivicluals  in  other  occupational  groups 
(Gollins.  Schroeder,  &:  Nye,  1 99 1 ;  Nye  &;  Collins.  1 991 ; 
Smith,  1983).  In  summary,  there  is  some  evidence  that 
individuals  attracted  to  the  A  FCS  occupation  differ 
from  other,  general  population  groups  along  at  least 
some  personality  dimensions. 


Personality  and  Performance 

Studies  finding  no  relationship.  Several  studies  on  the 
relationship  of  personality  to  A’FCS  training  and  on-the- 
job  performance  are  consistent  with  influential  reviews 
of  the  selection  literature  in  aviation  and  other  occupa¬ 
tions  which  concluded  that  the  validity  of  personality  as 
a  predictor  of  job  performance  is  low,  at  best  (Besco. 
1991,  Doigin  tSc  (itbb,  I9.S9;  tiuion  &  ttotricr,  196'i; 
Guion  S:  Gibson,  1 988;  Reilly  &  Chao,  1982;  Fenopyr 
&  OItjean,  1982).  For  example,  Colman  (1970)  de¬ 
scribed  a  study  conducted  by  Karson  and  O'Dell  ( 1 969) 
that  found  little  evidence  of  any  significant  relationship 
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bcfwci.'!!  scores  on  the  16PF  and  job  performance  ratings 
in  the  controller  Employee  Appraiud  Reeord.  Research  by 
Schroeder  (1984)  using  Barrett's  Impuhiren,.  .L.t/eand 
Manning  (1984)  using  Zuckcrman's  (1979)  Sensation 
Seeking  Sade  [ound  little  evidence  for  relations  between 
those  personality  constructs  and  ATOS  performance. 

Studies  finding  some  relationships.  On  the  other 
hand,  there  are  also  several  studies  ot  controllers  suggest¬ 
ing  that  there  is  a  relationship  between  personality  and 
Arcs  performance.  For  example,  Colman  also  cites 
work  bv  Buckley,  O’Connor,  and  Beebe  ( 1 969)  in  which 
statistically  significant  relationships  between  controller 
performance  on  an  air  traffic  control  simulation  and 
16PF  scores  vs'ere  reported  for  a  very  small  sample  of  .^6 
controllers.  More  recently,  Collins,  Nyc,  and  Schroeder 
(1991)  found  that  although  entry  level  controllers  re¬ 
ported  significantly  lower  levels  of  anxietv  on  the  State- 
Trai:  Personality  Inventory  [STPl,  Speilberger,  1979). 
self-reported  anxiety  was  still  related  to  success  in  initial 
A’FCS  training.  Individuals  reporting  higher  levels  of 
both  state  and  trait  anxiety  experienced  higher  failure 
rates  than  those  reporting  lower  levels  of  anxiety.  In  a 
study  from  the  United  Kingdom,  Nyficld,  Kandola,  and 
Saville  (198.3)  obtained  58  significant  correlations,  rang¬ 
ing  from  .  1 6  to  ..3 1  (N  =  112),  between  .32  Occupational 
Personality  Questionnaircs^ccites  ( OPQ.  Nyfield,  Kandola, 
&  Saville,  198.3)  and  22  measures  of  A  TCS  job  perfor¬ 
mance.  Several  of  the  correlations  were  related  to  techni¬ 
cal  proficiency  (e._^.,  ability  to  form  a  mental  picture  from 
flight  progress  strips  only).  But  a  majority  of  the  corre¬ 
lations  were  with  assessments  of  controller  relationships 
with  other  personnel  (e.g.,  cooperation  from  others, 
doesn't  experience  difficidty  in  relation  to  colleagues  and 
superv  isors).  In  Germany,  the  ATCS  selection  test  bat¬ 
tery  includes  personality  dimensions  such  as  Rigidity, 
Extroversion,  and  Emotional  Stability  (\-\<if,ic\dt.,  1990). 
1  he  validity  iR)  of  the  German  battery,  including  per¬ 
sonality  and  cognitive  dimensions,  with  various  training 
performance  criteria  ranged  from  ,5  1  to  .61  with  sample 
sizes  of  162  to  196  entry-level  controllers.  Unfortu¬ 
nately,  component  standardized  regression  coefficients 
were  not  reported. 

Critique  of  past  research.  At  the  time  when  most  of 
the  studies  just  reviewed  were  conducted,  there  was  little 
consensus  on  an  acceptable  taxonomy  for  classifying 
personality  traits  in  such  a  way  as  to  determine  if  there 


were  consistent,  meaningful  relationships  between  par 
ticular  personality  constructs  anti  )ob  performance  mea¬ 
sures  across  tests  and  across  or  with  in  occupations  (.Mount 
&  Barrick,  199! ).  Recent  meta-analv '-s  ol  a  large  num¬ 
ber  of  personality-oriented  validation  studies  bv  Barrick 
and  Mount  (1991)  and  Fett,  Jackson,  and  Roihstein 
{ 199  1 )  demonstrated  the  utility  of  the  "Big  Five  model 
of  personality  in  the  prediction  of  various  )ob  perfor¬ 
mance  criteria  across  many  occupations.  I  his  model  of 
personality  suggests  that  there  are  five  major  factors  of 
personality  as  described  by  factor  and  s'ructural  analvses 
of  the  domain  of  trait  labels  people  use  to  describe 
themselves  and  others  (Digman,  1990;  Ffofstee.  !‘)84; 
Hogan,  198.3:  John,  Angleitner.  &  Gstendorf.  1988; 
Norman.  196.3:  ’I'upcs  &  Chri.stal,  1961)  '1  ett.  et  ah, 
obtained  a  corrected  estimate  of  the  overall  relation 
between  “Big  Five'  personality  dimensions  and  job 
performance  measures  of  .24,  indicating  that  personality- 
may  have  utility  in  the  prediction  of  job  performance. 
1  his  line  of  research  on  the  validity  and  utility  of  the  '  Big 
Five  ”  model  of  personality  is  extended  to  the  .A  FGS 
occupation  in  this  study.  Our  specific  purposes  were  (a) 
to  investigate  the  differences,  if  any,  between  entry-level 
controllers  and  normative  samples,  and  (b)  to  assess  the 
incremental  validity  of  a  "Big  Five  measure  of  person¬ 
ality  over  cognitive  aptitude  in  the  prediction  of  perfor¬ 
mance  in  initial  ATC.S  training  at  the  FAA  .Academy. 

METHOD 

Sample 

Subjects  for  this  study  were  drawn  from  students  en¬ 
rolled  in  the  FAA  Academy  ATC.S  Nonradar  Screen 
program  befween  September,  1990  and  .May,  1991. 
Complete  personality,  aptitude,  and  training  perfor¬ 
mance  data  were  obtained  for  a  total  of  1,121  first-time 
entrants.  Sample  demographic  characteristics  arc  pre¬ 
sented  in  Fable  1  in  comparison  to  the  population  of 
FAA  Academy  entrants.  The  sample  was  composed 
mostly  of  non-minority  men  with  some  college  educa¬ 
tion  with  an  average  age  of  26  (range  from  1 8  to  32);  the 
majority  reported  some  college  education.  As  shown  in 
Table  1 .  this  sample  ofentry-level  controllers  was  typical 
of  the  population  of  Academy  entrants. 
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Table  1 

Sample  and  Population  Demographic  Characteristics  of  ATCS  Students 


Characteristic 

Category 

Population 
(A  =  9,945) 

Sample 
(A  =  1,091) 

Sex 

Men 

81.1%  (8,06.5) 

64.5%  (  723) 

Women 

18.9%  (1,880) 

27.4%  (  307) 

Missing 

8.1%  (  91) 

Ethnicity 

White 

87.0%  f8,650) 

73.7%  (  826) 

Asian 

1.1%  (  113) 

2.3%  (  26) 

Native  American 

0.6%  (  62) 

0.7%  (  8) 

African  American 

5.0%  (  502) 

9.5%  (  106) 

Hispanic  Non-white 

3.4%  (  340) 

4.6%  (  52) 

Unknown 

2.8%  (  278) 

9.2%  (  103) 

Age 

Mean 

26.1 

26.3 

SD 

4.9 

3.0 

Measures 

The  NEO  Personality  Inventory 

The  NEO  Personality  Inventory  (NEO-PF;  Costa  & 
McCrae,  1 985)  is  one  of  the  first  personality  inventories 
designed  to  explicitly  assess  the  five  major  personality 
dimensions  identified  over  the  course  of  more  than  50 
years  of  factor  analytic  research.!  he  NEO-Pl  was  devel¬ 
oped  through  a  series  of  overlapping  factor  analyses, 
longitudinal  studies,  and  peer  rating  studies,  using  samples 
of  adult  men  and  women  rather  than  just  college  stu¬ 
dents.  This  research  program  is  described  by  Costa  and 
McCrae  (1985;  1987,  1988a).  The  normative  samples 
consisted  of  502  men,  ranging  in  ages  from  21  to  93,  and 
481  women,  aged  19  to  93.  Estimates  for  coefficients  of 
reliability  for  the  scales  range  from  .85  to  .93;  tho.se  for 
test-rercst  reliability  range  From  .86  to  .91  (Costa  & 
McCrae,  1985,  1 988b).  !'he  five  primary  scales  compris¬ 
ing  the  NEiO'PI  are;  N euroticism  (N)\  Extraversion  (/:); 
Openness  to  experience  ( O) :  Agreeahleness  (A) ;  and  Consci¬ 
entiousness  {Q.  Each  of  the  N,  E,  and  Odomain  scales  are 
composed  of  six  subscales  assessing  specific  facets  ofcach 
domain.  As  a  result,  meaningful  individual  differences 
can  be  seen  within  domains,  providing  a  more  fine¬ 


grained  analysis  of  persons  or  groups.  Domain  and  facet 
scales  descriptions  arc  presented  in  Table  2. 

Aptitude 

A  written  aptitude  test  is  administered  by  the  E’.S.  Office 
of  Personnel  Management  (OPM)  as  the  first  hurdle  to 
entering  the  ATCh  occupation.  The  OP.M  ATCS  writ¬ 
ten  civil  service  examination  batters’  is  composed  of  three 
tests;  (a)  the  Multiplex  Controller  Aptitude  Test  (MCAT); 
(b)  a  test  of  Abstract  Reasoning  (ABSR):  and  ic)  an 
Occupational  Knowledge  7rsr(OKT).  The  general  devel¬ 
opment,  psychometric  characteristics,  and  s’alidiry  of 
this  test  battery  are  described  by  Sells,  Dailey,  and  Pickrel 
(1984).  Extensive  research  conducted  by  the  Civil  Acro- 
medical  Institute  indicates  that  scores  on  the  civil  service 
test  battery  arc  significantly  correlated  with  student 
performance  in  the  F'AA  Academy  ATCS  Screen  pro¬ 
gram  (Manning,  Della  Rocco,  &  Bryant.  1989;  Rock. 
Dailey,  Ozur,  Boone,  &  Pickerel,  1981).  Results  from 
the  test  battery  arc  combined  with  any  statutory  veteran's 
preference  to  yield  a  final  civil  service  rating  (RAT INC). 
This  rating  is  used  to  rank-order  A  ECS  job  applicants 
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within  statutory  guidelines  such  that  hiring  is  done  on 
the  basis  of  merit,  as  more  fully  described  in  Aul  (1991). 

Criterion 

The  FAA  Academy  Nonradar  Screen.  The  FAA  Acad¬ 
emy  Nonradar  Screen  (“the  Screen”)  was  established  in 
response  to  recommendations  made  by  the  U.S.  94th 
Congress  House  Committee  on  Government  Opera¬ 
tions  (U.S.  Congress,  1976)  to  reduce  field  training 
attrition  rates.  The  most  recent  version  of  the  Screen  was 
implemented  in  October  1985,  supplantitig  predeces¬ 
sor,  option-specific  (Terminal  and  En  Route)  programs 
in  place  from  1976  through  1985.  This  Screen  was 
revised  again  in  1986,  shortening  the  course  from  60  to 
42  working  days;  the  program  remained  relatively  stable 
in  content  and  process  until  it  was  terminated  in  March, 
1992.  The  Screen  was  based  upon  a  miniaturized  train¬ 
ing-testing-evaluation  personnel  selection  model  (Siegel, 
1978,  1983;  Siegel  &  Bergman,  1975)  in  which  indi¬ 
viduals  with  no  prior  knowledge  of  the  occupation  could 
be  assessed  for  their  potential  to  succeed  in  air  traffic 
control. 

Performance  measures.  The  Screen  was  developed 
with  a  clear  emphasis  on  the  assessment  of  developmen¬ 
tal  performance  using  multiple  methods  (Boone,  1 984). 
As  a  result,  thirteen  assessments  of  performance  were 
made  during  the  Screen  (Delia  Rocco,  Manning,  & 
Wing,  1990).  These  measures  were  derived  from,  tests 
administered  in  the  classroom,  observed  performance 
during  laboratory  simulations  of  non-radar  air  traffic 
control,  and  a  final  written  examination.  The  measures 
were  summed  and  weighted  to  create  a  final  composite 
Screen  score  (COMP),  ranging  from  a  theoretical  mini¬ 
mum  of  1 2  to  a  maximum  of  100.  A  minimum  score  of 
70  was  required  to  pass  the  Screen.  Failure  in  the  Screen 
resulted  in  the  removal  of  the  student  from  the  ATCS 
occupational  series  at  the  very  least,  and  often  in  termi¬ 
nation  from  employment  with  the  FAA.  The  final  com¬ 
posite  score  (COMP)  was  the  training  performance 
criterion  of  interest  in  this  study. 


Procedure 

Comparison  to  norms 

Three  analytic  procedures  were  employed  to  explore 
possible  differences  between  persons  entering  the  ATCS 
occupation  and  the  general  population.  First,  mean 
scores  for  the  sample  of  entry-level  controllers  on  the 
main  and  facet  scales  of  the  NEO-Pl  were  compared 
with  the  published  norms.  The  null  hypothesis  that  there 
were  no  differences  between  entry'-level  controllers  and 
normative  groups  was  tested  by  f  test  computed  on  the 
pooled  variances  of  the  groups.  The  overall  risk  of  Type 
I  errors  across  the  multiple  comparisons  was  minimized 
through  the  use  of  an  unordered  Bonferonni  procedure 
(Rosenthal  &  Rubin,  1984).  The  corrected  criterion  a 
for  any  given  t  test  was  .004,  based  on  12  comparisons 
for  each  sex.  Second,  mean  differences  were  translated 
into  Common  Language  Effect  Sizes  (Cl.;  McGraw  & 
Wong,  1992)  as  an  aid  to  clarifying  the  practical  signifi¬ 
cance  of  any  differences.  The  CL  metric  for  effect  size  is 
the  number  of  times  out  of  100  that  a  randomly  sampled 
entry  level  controller  (group  1)  will  have  a  higher  score 
on  a  given  personality  scale  than  a  randomly  sampled 
person  from  the  general  (normative)  population  (group 
2).  For  example,  if  CL  =  68  with  respect  to  the  Extraver¬ 
sion  dotmin  scale  of  the  NEO-Pl,  we  would  expect  that, 
for  any  random  pairing  of  a  controller  with  a  member  of 
the  general  normative  population,  the  controller  would 
have  the  higher  score  2  out  of  3  times.  A  CZ.  of  50  suggests 
that  compared  to  a  normative  sample  controllers  would 
be  no  more  likely  to  have  higher  scores  on  a  scale  than 
might  be  expected  by  chance  alone.  The  third  analytic 
procedure  illustrates  these  mean  differences  and  effect 
sizes  in  terms  of  the  degree  or  percent  of  overlap  in  the 
distribution  ofscale  scores  for  the  controllers  and  norma¬ 
tive  groups.  The  greater  the  amount  of  overlap,  as 
indicated  by  Tilton's  O  ( 1 937)  statistic,  the  less  effective 
a  scale  is  in  separating  or  discriminating  between  the  two 
distributions.  Taken  together,  these  three  analytic  proce¬ 
dures  provided  information  about  potential  differences 
between  entry-level  controllers  and  members  of  the 
normative  populations. 
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Table  2 

NEO-PI  Domain  and  Facet  Scale  Interpretations 


Low  Scores 

Scale 

High  Scores 

Calm,  stable,  relaxed, 
secure,  deliberate 

NEUROTICISM  (N) 

Worried,  tense,  unstable, 
nervous,  impulsive 

Relaxed,  calm 

Amiable,  even-tempered 
Hopeful,  feels  worthwhile 
Secure,  comfortable 

Self-controlled 

Resilient,  hardy 

Anxiety  (Nl) 

Hostility  (N2) 
Depression  (N3) 
Self-consciousness  (N4) 

Impulsiveness  (N5) 
Vulnerability  (N6) 

Fearful,  worried 

Angry,  easily-frustrated 
Guilty,  hopeless 

Ashamed,  easily 
embarrassed 

Impulsive,  unable  to  resist 
Intolerant  of  stress 

Reserved,  aloof,  quiet, 
reticent 

EXTRA  VERSION  (E) 

Outgoing,  gregarious, 
talkative,  energetic 

Cold,  formal 

Solitary,  self-contained 
Unassuming,  retiring 

Slow,  deliberate 

Cautious,  staid 
Unenthusiastic,  serious 

Warmth  (El) 
Gregariousness  (E2) 
Assertiveness  (E3) 
Activity  (E4) 
Excitement-seeking  (E5) 
Positive  Emotions  (E6) 

Talkative,  affectionate 
Convivial 

Dominant,  forceful 

Energetic,  vigorous 

Flashy,  takes  risks 

Cheerful,  high-spirited 

Unlearned,  realistic, 
pragmatic,  dogmatic 

OPENNESS  TO  EXPERIENCE  fO; Inquiring,  analytical, 

tolerant,  curious 

Realistic,  practical 

Insensitive  to  art  and  beauty 
Narrow  range  of  emotions 
Prefers  familiar,  routine 
Pragmatic,  factual 

Dogmatic,  conservative 

Fantasy  (01) 
Aesthetics  (02) 

Feelings  (03) 

Actions  (04) 

Ideas  (05) 

Values  (06) 

Imaginative 

Moved  by  art  and  beauty 
Empathic,  values  feelings 
Prefers  new,  novel 

Curious,  analytical 

Tolerant,  non-conforming 

Cynical,  rude,  ruthless, 
uncooperative 

AGREEABLENESS  (A) 

Trusting,  helpful,  forgiving, 
gullible 

Unreliable,  disorganized, 
negligent 

CONSCIENTIOUSNESS  (C) 

Organized,  reliable, 
punctual,  obedient 
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Table  3 

Comparison  of  Men  Controller  NEO-PI  Domain  Scale  Scores  to 
Adult  and  College  Men  Norms 
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Prediction  of  performance 

Zero-order  correlations  between  the  final  OPM  raiingat 
hire  (RAI  INCi),  personality  facet  and  domain  scale 
scores,  and  final  Screen  composite  score  (COMP)  were 
computed.  7'hese  correlations  were  not  corrected  for 
direct  and  incidental  restriction  in  range  due  to  selection 
of  subjects  on  the  OP.M  rating  at  hire.  Therefore,  the 
estimates  from  this  analysis  represent  lower-bound  esti¬ 
mates  of  the  relationships  between  aptitude,  personality, 
and  penormance  in  the  general  population.  Blocksvise 
multiple  regression  analysis  was  used  to  asse.ss  the  incre¬ 
mental  validity  of  the  personality  scales  over  that  of  the 
aptitude  measure  in  the  prediction  ofperformance  in  the 
FAA  Academy  ATCS  Screen  program.  The  OPM  rating 
at  hire  was  entered  into  the  regression  equation  in  the 
first  block  in  order  to  identify  the  proportion  of  variance 
in  Screen  performance  accounted  by  cognitive  aptitude. 
The  personality  M  E,  and  O  facet  scales  and  A  and  C 
domain  scales  were  examined  in  the  second  block  using 
stepwise  regression.  Use  of  this  procedure  provided  an 
assc-ssment  of  the  additional  significant  variance  in  Screen 
performance  accounted  for  by  personality  beyond  that 
already  accounted  for  by  the  genera!  cognitive  aptitude 
measure.  The  null  hypothesis  was  that  personality  mea¬ 
sures  would  not  account  for  additional  variance  in  Screen 
performance  beyond  that  accounted  for  OPM  rating. 


RESULTS 

Comparison  to  norms 

Men 

Domain  scales.  Means  and  standard  deviations  for  the 
NtO-Pl  domain  .scale  scores  for  the  men  ATCS  stu¬ 
dents.  adult  men,  and  college  men  are  presented  in  1  able 
3.  While  thea-  appeared  to  be  some  degree  of  overlap 
between  etitry-lcvel  controllers  and  both  adult  and  col¬ 
lege  men  normative  distributions  (Table  4).  the  r  tests 
and  Cl.  effect  sizes,  using  a  criterion  of  CL<  25  or  >  75, 
indicated  important  differences  betwe-  o  the  groups  in 
the  overall  profiles.  ATC.Ss  differed  significantly  from 
adult  men  on  4  of  the  5  domain  scales  (all  except 
Ayeeahleness)  and  from  college  men  on  each  of  the 
domains.  As  a  group,  A’fCSs  reported  significantly 
lower  (/»  <  .004)  neuroticism  than  the  adult  or  college 
men.  The  CL  suggest  that  9  or  fewer  entry-level  control¬ 
lers  might  be  expected  to  have  higher  N  scores  than 
normative  adult  or  college  men  in  100  random  pairings, 
ATCSs  were  also  more  extroverted  and  conscientious 
than  either  adult  men  or  college  men,  with  far  more 
controllers  expected  to  have  higher  £and  Cscores  than 
normative  men  in  100  random  pairings. 

On  the  Openness  to  Experience d  mcnsion,  ATC.Ss  had 
higher  scores  than  adult  men  (p  <  .004)  but  lower  than 


Table  4 

Percentage  Overlap  (Tilton's  O)  in  Controller  and  Normative 
Distributions  for  Men  on  NEO-PI  Domain  Scales 


Domain  Scale 

Overlap  of  ATCS  Men  with 

Adult  Men  College  Men 

{N  =  502)  (A^  =  250.) 

Neuroticism 

82% 

59% 

Extraversion 

56% 

88% 

Openness 

91% 

80% 

Agreeableness 

99% 

83% 

Conscientiousness 

84% 

60% 
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Table  5 

Comparison  of  Men  Controller  Neuroticism 
Facet  Scores  to  Adult  and  College  Men  Norms 
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Table  6 


Porccntage  Ovcrbp  (Tilton's  O)  in  Controller 
and  Normative  Distributions  lor  Men  on  NfX)-PI  Facet  Scales 


Overlap  of  Men  ATCS  Students  with 

Adult  Men 

College  Men 

FACET 

(N  =  502) 

(N  =  250) 

NEUROTICISM 

Anxiety 

96% 

76% 

Hostility 

88% 

73% 

Depression 

82% 

62% 

Se!  f-Consciousness 

90% 

77% 

Impulsiveness 

91% 

66% 

Vulnerability 

71% 

60% 

EXTRAVERSION 

Warmth 

86% 

86% 

Gregariousness 

77% 

99% 

Assertiveness 

81% 

79% 

Activity 

73% 

87% 

Excitement-Seeking 

46% 

99% 

Positive  Emotions 

68% 

100% 

OPENNESS 

Fantasy 

94% 

70% 

Aesthetics 

93% 

74% 

Feelings 

88% 

83% 

Actions 

95% 

68% 

Ideas 

80% 

89% 

Values 

97% 

94% 

college  men  (p  <  .004).  Average  ATCS  scores  on  the  A 
.scale  did  not  differ  from  those  of  adult  men  but  were 
higher  than  those  of  college  men  (/)  <  .004). 

Facet  scales.  Comparisonsoftheavxi-gc  ATCS  men’s 
scores  on  the  6  N  facet  scales  with  those  of  the  two 
normative  groups  appear  in  Table  5,  with  ovetlap  in 
distributions  presented  in  Table  6.  The  pattern  of  scores 
for  the  three  groups  was  consistent  on  each  of  the  6  facets, 
except  for  Anxirty.  That  was  the  only  facet  on  which 
scores  for  AT CS  men  and  adult  men  did  not  significantly 
differ.  Otherwi,se,  college  men  had  g'’nerally  higher 
average  scores  on  the  N  facets,  adult  men  were  in  the 


middle,  and  men  controllers  had  lower  average  scores.  As 
shown  in  Table  6,  there  was  less  overlap  between  entry- 
level  controller  and  college  men  distributions  than  with 
adult  men.  Means,  standard  deviations,  results  of  the  t 
tests  and  CL  estimates  for  the  three  men’s  groups  on  the 
6  Efacct  subscales  arc  presented  in  Table  7.  Mean  scores 
for  men  controllers  were  significantly  higher  than  for 
adult  men  on  each  of  the  six  Efacets  (p<  .004).  However, 
controllers  differed  from  their  college  counterparts  on 
only  the  Warmth,  Assertiveness,  and  Activity  facets,  with 
controllers  presenting  higher  mean  scores.  Overall,  the 
effect  sizes  in  Table  7  and  overlap  indices  pres''nted  in 
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Table  8 

Comparison  of  Men  Controller  Openness  to 
Experience  Facet  Scores  to  Adult  and  College  Men  Norms 
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Table  10 

Percentage  Overlap  (Tilton's  O)  in  Controller 
and  Normative  Distributions  for  Women  on  NEO-PI  Domain  Scales 

Overlap  of  Women  ATCS  Students  with 

Domain  Scale  Adult  Women  College  Women 

{N  =  481)  {N  =  276) 


Neuroticism 

74% 

49% 

Extraversion 

57% 

78% 

Openness 

93% 

87% 

Agreeableness 

97% 

89% 

Conscientiousness 

77% 

57% 

Table  6  suggested  that  entry-level  controllers  were  more 
similar  to  college  men  in  the  E  domain  than  to  adult 
men.  Means,  standard  deviations,  t  tests,  and  CL  esti¬ 
mates  for  the  O  facet  subscales  are  presented  in  Table  8. 
Average  scores  for  ATCS  men  were  significantly  higher 
than  those  of  adult  men  on  the  Feelings  (p  <  .004)  and 
Ideas  ip  <  .004)  facets.  Men  controllers  differed  signifi¬ 
cantly  from  college  men  on  each  of  the  O  facets  except 
Actionsund  Values.  Compared  to  the  ATCS  men,  college 
men  were  higher  on  Fantasy,  Aesthetics,  and  Feelings,  but 
lower  on  Ideas.  Overall,  the  pattern  of  CL  effect  size 
estimates  and  overlap  in  distributions  suggested  that 
entry-level  controllers  were  more  similar  to  adult  men  in 
terms  of  their  openness  to  experience  than  they  were  to 
college  men. 

Women 

Domain  scales.  Comparisons  of  the  means  and  standard 
deviations  for  women  ATCSs,  adult  women,  and  college 
women  on  the  5  NEO-PI  domains  appear  in  Table  9. 
Estimates  of  the  degree  of  overlap  between  controller 
and  normative  .score  distributions  are  presented  in  Table 
10  foi  the  domain  scales.  Scores  for  ATCS  women 
differed  significantly  from  tho.se  of  adult  women  on  3  of 
the  5  dimensions  and  from  college  women  on  each  cf  the 


5  dimensions.  Women  entry  controllers  did  not  differ 
from  adult  women  on  the  Agreeableness  and  Openness 
domain  scales.  In  comparison  to  adult  women,  ATCSs 
reported  less  neuroticism  and  greater  extra  version,  open¬ 
ness,  and  conscientiousness.  They  also  appeared  to  have 
less  neuroticism  and  openness  than  college  women. 
Women  ATCSs  were  more  extravened  and  exhibited 
higher  agreeableness  and  conscientiousness  scores  than 
did  their  college  counterparts.  Overall,  the  pattern  of 
effect  sizes  and  degree  of  overlap  between  distributions 
(Table  lO)  suggested  that  entry-level  women  controllers 
were  more  similar  to  adult  women  than  they  were  to 
college-aged  women. 

Facet  scales.  Table  1 1  presents  the  means,  standard 
deviations  and  rtest  comparisons  for  the  three  groups  on 
the  6  Neuroticism  facet  subscales.  ATCS  women  had 
significantly  lower  scores  (p  <  .004)  than  either  adult 
women  or  college  women  on  5  of  the  6  Afacets:  women 
controllers  and  adult  women  did  not  differ  on  the 
Impulsivehcei.  The  pattern  of  scores  for  the  three  groups 
was  similar  to  that  noted  for  men,  ATCS  women  had  the 
lowest  scores,  adult  women  were  in  between,  and  college 
women  had  the  highest  scores.  Overall,  the  pattern  of 
overlap  between  distributions  (Table  12)  and  CL  effect 
sizes  suggested  that  entry-level  women  controllers  were 
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Table  11 

Comparison  of  Women  Controller  Neuroticism 
Facet  Scores  to  Adult  and  College  Women  Norms 


Table  12 

Percentage  Overlap  (Tilton's  O)  in  Controller 
and  Normative  Distributions  for  Women  on  NEO-PI  Facet  Scales 


Overlap  of  ATCS  Women  with 

Adult  Women 

College  Women 

Facet  Scale 

(A  =  481) 

(V  =  276) 

NEUROTICISM 

Anxiety 

82% 

59% 

Hostility 

89% 

68% 

Depression 

71% 

55% 

Self-Consciousness 

81% 

64% 

Impulsiveness 

91% 

84% 

Vulnerability 

63% 

51% 

EXTRA  VERSION 

Warmth 

92% 

78% 

Gregariousness 

82% 

98% 

Assertiveness 

76% 

71% 

Activity 

75% 

79% 

Excitement-Seeking 

41% 

99% 

Positive  Emotions 

72% 

88% 

OPENNESS 

Fantasy 

98% 

72% 

Aesthetics 

86% 

77% 

Feelings 

93% 

82% 

Actions 

88% 

92% 

Ideas 

78% 

86% 

Values 

87% 

93% 

more  similar  to  adult  women  in  terms  of  the  //domain 
and  its  facets  than  they  were  r^  college  women.  Compari¬ 
sons  of  the  means  and  standard  deviations  for  the  three 
women  groups  on  the  Extraversion  facet  subscales  are 
presented  in  Table  13.  Average  scores  for  women  ATCSs 
were  significantly  higher  than  those  of  the  adult  women 
on  5  of  the  6  E  facet  subscales  and  higher  than  those  of 
college  women  on  4  of  the  6  subscales.  The  largest  mean 
difference  occurred  on  the  Excitement-seeking  (E5) 
subscale  (20.3  for  ATCSs  versus  1 2.9  for  adult  women); 
women  controllers  would  be  expected  to  have  higher  E5 
scores  than  adult  women  in  99  out  of  100  random 


pairings.  In  general,  the  pattern  of  overlap  between 
controller  and  normative  sample  distributions  on  the  E 
facet  scales  (Table  1 2)  suggested  that  women  controllers 
were  mote  similar  to  college  women  than  adult  women 
in  terms  of  their  extraversion.  Finally,  facet  scores  for  the 
Odomain  subscales  are  compared  in  Table  14.  Women 
controllers  had  significantly  higher  scores  than  adult 
women  on  the  IdeasmA  Vd/K« facets.  The  CZ. effect  size 
estimates  indicated  that,  on  the  average,  women  control¬ 
lers  would  be  expected  to  have  higher  scores  on  these 
facets  than  would  adult  women.  On  the  other  hand, 
women  controllers  would  be  expected  to  have  lower 
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Table  13 

Comparison  of  Women  Controller  Extraversion 
Facet  Scores  to  Adult  and  College  Women  Norms 
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Table  14 

Comparison  of  Women  Controller  Openness  to 
Experience  Facet  Scores  to  Adult  and  College  Women  Norms 
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Table  15 

NEO-PI  Domain  and  Facet  Scale  Scores  for  Controllers  by  Sex 


Male  ATCS  Female  ATCS 

(A  =  723)  (N  =  307) 


DOMAIN/Facet  Scale 

M 

SD 

M 

SD 

t 

CL 

NEUROTICISM 

64.6 

19.1 

66.3 

20.2 

-1.28 

39 

Nl)Anxiety 

12.5 

4.5 

13.0 

4.5 

-1.63 

43 

N2)Hostility 

9.4 

4.4 

9.1 

4.2 

I.Ol 

54 

N3)Depression 

9.3 

4.5 

9.2 

4.9 

0.32 

51 

N4)Self-consciousness 

12.6 

4.4 

12.4 

4.4 

0.67 

53 

N5)Impulisve 

14.0 

4.3 

15.1 

4.9 

-3.60'" 

36 

N6)Vulnerabi!ity 

6.9 

3.6 

7.5 

3.6 

-2.45 

41 

EXTRAVERSION 

121.7 

16.8 

124.5 

17.0 

-2.44 

33 

El)Warmth 

23.6 

4.1 

24.5 

3.9 

-2.44 

38 

E2)Gregariousness 

17.3 

4.5 

17.9 

4.6 

-1.94 

42 

E3)Assertiveness 

18.8 

4.1 

19.0 

4.7 

-0.68 

47 

E4)Activity 

19.0 

3.9 

19.8 

4.3 

-2.92 

39 

E5)Excitement-seeking 

21.6 

4.3 

20.3 

4.6 

4.34"* 

67 

E6)Positive  Emotions 

21.5 

4.2 

23.1 

4.0 

-5.67"* 

29 

OPENNESS 

113.0 

15.8 

118.2 

15.8 

-4.83*** 

18 

01)Fantasy 

17.3 

4.1 

17.2 

5.0 

0.31 

51 

02)Aesthetics 

15.8 

5.7 

17.8 

5.2 

-5.28‘" 

28 

03)Feelngs 

20.7 

4.0 

22.5 

3.8 

-6.70*" 

26 

04)Actions 

16.1 

3.5 

17.2 

3.7 

-4.53*** 

34 

05)Ideas 

22.0 

4.6 

21.3 

4.7 

2.22 

41 

06)  Values 

21.2 

4.4 

22.3 

3.8 

-3.82*** 

35 

AGREEABLENESS 

48.3 

7.0 

51.0 

6.6 

-5.76*** 

23 

CONSCIENTIOUSNESS 

52.9 

8.0 

55.2 

7.6 

-4.28*” 

28 

NOTES:  CL  =  Common  Language  Effect  Size,  ^  .004 

or  number  of  times  that  men  would  have  higher 
scores  than  women  in  100  random  pairings 
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scores  on  the  Aesthetiai'icci  than  would  adult  women.  In 
contrast,  women  controllers  differed  significantly  from 
college  women  on  4  of  the  6  O  facet  scales.  Women 
controllers  were  more  likely  to  have  lower  scores  than 
college  women  on  the  Fantasy,  Aesthetics,  and  Feelings 
facets,  and  higher  scores  on  the  Ideas  hcet.  Overall,  the 
pattern  of  overlap  and  effect  sizes  suggested  that  women 
controllers  were  more  similar  to  adult  women  on  the  first 
three  facets  {Fantasy,  Aesthetics,  and  Feelings)  and  more 
similar  to  college  women  on  the  Actions,  Ideas,  and 
Values  facets. 

Comparison  of  Men  and  Women  Controllers 

Means  and  standard  deviations  for  the  NEO-PI  domain 
and  facet  scales  for  men  and  women  ATCS  students  are 
presented  in  Table  1 5.  While  there  was  some  degree  of 
overlap  between  the  sexes,  the  t  tests  and  CL  effect  sizes 
revealed  that  men  and  women  differed  significantly  and 
practically  on  3  of  the  5  domain  scales.  Women  ATCSs 
had  higher  scores  than  men  on  the  O,  A,  and  Cdomain 
scales  {/><  .004).  The  higher  0  scores  for  women  ATCS 
students  were  consistent  with  sex  differences  reported  by 
Costa  and  McCrae  (1989).  Averages  for  women  were 
also  higher  than  men  on  the  N and  E domain  scales,  but 
did  not  meet  the  practical  cutoff  of  25  <  CL>  75.  None 
of  the  differences  noted  on  the  facet  scales  between  men 
and  women  met  the  stipulated  cutofffor  practical  signifi¬ 
cance,  although  there  were  several  statistically  significant 
differences  of  interest.  For  example,  men  were  less  im¬ 
pulsive  (N5)  and  reported  less  positive  emotions  (E6) 
than  women  controllers  (p  <  .004),  but  sought  more 
excitement  (E5).  Women  had  higher  scores,  on  the 
average,  than  men  controllers  on  4  of  the  6  Opennessficei 
scales:  Aesthetics  (02),  Feelings  (03),  Actions  (04),  and 
Values  (06).  Overall,  men  and  women  entry-level  con¬ 
trollers  appeared  to  have  quite  similar  profiles,  with 
womengenerally  having  just  slightly  elevated  scores  over 
men. 


Prediction  of  Performance 
Correlations 

Zero  order  correlations  between  the  mea.surc  of  cognitive 
aptitude  (RATING)  for  the  ATCS  occupation,  NEO-PI 
facet  and  domain  .scale  scores,  and  final  composite  score 
(COMP)  in  the  screen  for  both  men  (/V=  529)  and  women 
{N  =  193)  cases  with  complete  valid  data  arc  presented  in 
Tables  16  and  17.  Correlations  between  aptitude  (lEAl  - 
ING)  and  personality  .scores  for  men  ranged  from  a  low  of 
.000  with  Impulsive  (N5)  to  an  absolute  maximum  of  .098 
with  the  IdeasiO’y)  facet.  Correlations  between  aptitude  and 
personality  scores  for  women  were  similarly  low,  ranging 
from  .002  with  Fantasy  {0\)  to  a  high  of  .169  with  Values 
(06).  Correlations  between  the  personality  measures  and 
Academy  screen  score  (COMP)  for  men  were  also  low, 
ranging  from  -.005  for  Aesthetics (02)  to  -.  1 48  with  the  facet 
£xcirement-seehng(E5).Thc  pattern  ofcorrelations  between 
personality  and  performance  for  women  was  very'  similar, 
with  generally  low  correlations  ranging  from  -.005  with 
Assertiveness  (E3)  to  .  1 78  with  Ideas  (05). 

Regression 

Results  of  the  regression  analysis  to  determine  if  the  person¬ 
ality  variables  contributed  to  the  prediction  of  Academy 
Screen  performance  above  that  contributed  by  cognitive 
aptitude  are  presented  in  Table  18  by  sex.  The  results 
suggested  that  the  null  hypothesis  should  be  rejected  for  both 
men  and  women  controllers.  There  was  a  small,  but  signifi¬ 
cant  increase  in  incremental  validity  for  men  when  person¬ 
ality  variables  entered  the  prediction  equation  (AR-  =  .033, 
AT  (4,524)  =  3.84,  p  <  .05),  The  significant  personality 
factors  included  the  Fanta^  (01),  Excitement-seeking  (f.^), 
and  Activity  (E4)  facets.  However,  the  total  percentage  of 
explained  variance  that  those  three  variables  added  was  quite 
small  (3%).  Just  one  facet,  Ideas  (05),  entered  the  stepwise 
regression  solution  for  women,  after  entering  aptitude  into 
the  prediction  equation  (AR^  -  .028,  AT(2,190)  =  5.53, /> 
<  .05).  As  with  men,  personality  accounted  for  a  bare  3%  of 
additional  explained  variance  in  performance  above  that 
already  explained  by  cognitive  aptitude. 
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Table  16 

Zero-Order  Correlations  Between  Cognitive  Aptitude  (RATING), 

NEO-PI  Facet  and  Domain  Scale  Scores,  and  Final  Screen  Composite  Score  (COMP)  for  Men  (N=529) 
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Table  1 7 

Zero-Order  CorreLitions  Between  Cognitive  Aptitude  (RATING), 

NEO-PI  Fucet  ind  Domain  Scale  Scores,  and  Final  Screen  Composite  Score  (COMP)  for  Women  (N=I93) 
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Table  18 


Regression  Analysis  of  Incremental  Validity  of  Personality 
Over  Aptitude  in  Prediction  of  ATCS  Screen  Performance  by  Sex 


Step 

Var 

R 

Adj-/?' 

AR- 

AF 

F 

idf) 

Men 

1 

RATING' 

.230 

.230 

.053 

.051 

29.34"' 

(1,527) 

2 

RATING 

E5- 

.220 

-.132 

.265 

.070 

.067 

.017 

9.86" 

19.85*** 

(2,526) 

3 

RATING 

E5 

01 

.215 

-.147 

.094 

.281 

.079 

.074 

.009 

4.92* 

14.97*** 

(3,525) 

4 

RATING 

E5 

01 

E4 

.214 

-.173 

.101 

.086 

.292 

.086 

.079 

.007 

3.84* 

12.25*** 

(4.524) 

Women 

1 

RATING 

.148 

.148 

.022 

.017 

4.25* 

(1,191) 

2 

RATING 

05 

.133 

.167 

.222 

.049 

.039 

.028 

5.53* 

4.94" 

(2,190) 

NOTES: 

^RATING  was  entered 

.05  *> 

j<  .01  ' 

'**/)  ^  .001 

‘E5  =  Excitement-seeking; 
01  =  Fantasy; 

05  =  Ideas; 

E4  =  Activity 
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DISCUSSION 

Differences  Between  Controllers  and  General 
Population 

Practical  versus  statistical  significance.  Overall,  most  of 
the  comparisons  between  entry-level  controllers  of  both 
sexes  to  their  respective  adult  and  college  normative 
samples  were  statistically  different.  Flowever,  the  rela¬ 
tively  large  sample  sizes  provided  a  great  deal  of  statistical 
power,  such  that  even  very  small. />r(rcf/ivj//v  insignificant 
differences  cmdcl  be  reliably  detected.  In  this  study, 
l  ilton  s  and  the  Common  Language  Lffect 

Si/e  ((,/.;  .\lcCraw  &  \X’ong,  l‘)92)  were  employed  to 
evaluate  the  practical  magnitude  of  any  detected  statisti¬ 
cal  differences.  Of  the  two.  Cl  appeared  to  provide  a 
more  parsimonious  description  of  differences  by  describ¬ 
ing  the  number  of  occasions  certain  differences  were 
likely  to  be  observed  in  a  random  pairing  of  100  cases 
from  each  sample.  In  general,  the  patterns  of /test  results 
combined  with  the  overlap  and  effect  size  estimates 
indicated  that  women  entry-level  controllers  were  lower 
in  neuroticism  and  higher  on  extraversion  and  conscien¬ 
tiousness  than  either  the  adult  or  college  women  norma¬ 
tive  groups,  and  that  these  differences  were  practically  as 
well  as  statistically  significant.  Differences  berween  men 
entry-level  controller'  and  adult  men  were  generally 
similar  to  those  noted  for  women.  Men  controllers  were 
expected  to  have  higher  C'seores  than  adult  men  in  78  of 
100  random  pairings;  in  comparison,  controllers  were 
expected  to  have  higher  E  scores  in  99  of  100  pairings 
compared  to  a  higher  /V  score  in  only  9  of  100  such 
pairings,  E'.ntry-level  men  controllers  were  lower  in 
neuroticism.  openness  to  experience,  and  consciernious- 
ness  than  college  men.  For  example,  men  ATCSs  were 
expected  to  have  higher  conscientiousness  than  college 
men  in  just  2  of  100  pairings,  indicating  that  the  statis¬ 
tical  difference  between  men  controllers  and  college  men 
on  the  C'domain  was  practically  significant. 

Profile  interpretation 

Given  these  apparent  differences  between  controllers 
and  normative  samples,  how  would  men  and  women 
controllers  be  described  on  the  basis  of  the  NEO-Pl 
profile?  Overall,  Al'CSs  scored  in  the  low-average  range 
ofthe  Neuroticism domlirx.  Similar  individuals  might  be 
seen  as  being  generally  calm  and  able  to  deal  with  stress; 


however,  they  would  still  experience  a  normal  amount  of 
disappointment  and  anger.  I  he  A  1  GS  group,  as  a  w  hole, 
had  stores  in  the  upper-range  of  the  Extrai  cruoti  do 
main.  Individuals  with  these  scores  are  cheerful,  gener¬ 
ally  satisfied  with  life,  and  prefer  excitement  and 
stimulatitsn  along  with  the  company  of  others  most  of 
the  time.  The  Openness  to  Experience  scores  for  these 
entry-level  controllers  suggested  that  they  could  bechar- 
acicri/cd  as  having  broad  interests,  knowledgeable  about 
manv  topics,  and  as  being  intellectually  curious  or  inves 
tigative.  Fhc  distribution  of  scores  in  the  A^eeahleness 
domain  hinted  that  some  A  Lf.Ss  present  themselves  as 
generally  warm,  trusting,  agreeable,  and  sympathetic  to 
others  while  others  present  themselves  as  more  tough 
minded,  skeptical,  and  ompctitivc.  ATC.S  group  scores 
in  the  Oonsetenttousness  dnmiin  were  also  in  the  mid- 
range.  Such  scores  suggest  that  the  entry-level  controllers 
exhibit  an  average  level  ofdetermination,  reliability,  and 
self-direction  Dverall,  the  pattern  of  scores  for  men  and 
women  controllers  suggested  a  certain  level  of  intensity, 
energy,  ambition  or  purpose,  gregariousness,  and  gener¬ 
ally  good  adjustment  within  this  sample  of  controllers. 
Women  entiy-level  controllers,  in  particular,  appeared 
to  be  more  dominant  and  forceful  than  their  normative 
peers. 

CONCXUSION.S  ABOUT  DlFFERf.NCE.S 
Between  Controllers  and  General 
Population 

Persons  who  enter  the  FAA  Academy  ATCS  Nonrasiar 
.Screen  program  do  differ  from  college  students  and 
adults  on  a  number  of  personality  dimensions  as  assessed 
by  the  NEO-Pl.  Differences  were  found  generally  on 
domain  scales,  with  those  differences  being  traced  in 
some  cases  to  specific  lacets  within  a  domain.  Those 
differences  were  similar  for  men  and  women  controllers: 
controllers  were  more  outgoing  and  had  higher-levels  of 
cxcitcmcnt-sceking,  expressed  more  positive  emotions, 
and  were  more  conscientious  than  the  normative  samples. 

Some  ofthe  differences  noted  above,  however,  may  be 
attributable  to  the  tendency  for  job  applicants  and 
employees  undergoing  evaluations  to  present  themselves 
in  a  positive  light.  Previous  research  with  the  16PF  and 
ATCS  applicants  and  job  incumbents  supports  the 
presence  of  positive  self-presentation  (Karson  &  O'Dell, 
1974:  Schroeder  &  Dollar,  1989).  However,  the 
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Jitferences  between  ATC^S  studeius  and  the  normative 
proiips  were  not  evident  across  each  of  the  dimensions  or 
facets  of  the  NLO-Pl  that  one  would  expect  to  he 
sensitive  to  a  positive  test-taking  attitude  (e.jj-. 
Agreeableness) . 

Utility  of  Personality  Measures 

Selected  aspects  of  personality  also  demonstrated  incre¬ 
mental  validity  over  cognitive  measures  in  the  prediction 
of  performance  in  the  FAA  Academy  A’l'CS  Nonradar 
Screen  program.  Two  of  three  facets  that  contributed  to 
the  final  regression  equation  were  drawn  from  the  O/te/r- 
ness  to  ExperienceAomim.  That  finding  is  consistent  with 
Barrick  and  Mount’s  ( 1991 )  conclusion  that  scores  from 
the  Odomain  were  likely  to  be  related  to  performance  in 
training. 

While  the  absolute  amount  of  additional  variance 
explained  was  small  (2%),  such  marginal  gains  have 
significant  utility  impacts  in  large-scale  selection  systems 
such  as  that  for  controllers.  For  example,  the  increase  in 
the  proportion  of  employees  considered  satisfactorv'  from 
the  use  of  aptitude  plus  personality  measures  can  be 
estimated  using  the  Taylor-Russell  tables  (Taylor  &C 
Russell,  1939).  Overall,  about  60%  of  persons  entering 
the  Screen  were  successful.  The  current  selection  ratio, 
based  on  the  cognitive  aptitude  ratings,  is  about  ,10.  The 
validity  coefficient  of  the  cognitive  aptitude  rating  by 
itself  for  this  sample  of  men  was  about  .23.  and  for 
women,  .15.  The  validity  coefficient  for  the  combined 
group  was  .23.  About  74%  of  the  combined  sample  of 
men  and  women  entry-level  controllers  would  have  been 
predicted  to  succeed  in  the  Screen,  based  on  interpola¬ 
tion  of  the  Taylor-Russell  tables.  The  validity  coefficient 
for  the  cognitive  aptitude  rating  plus  personality  facets 
was  .29  for  men  and  .22  for  women,  or  about  .27  for  the 
combined  sample.  The  interpolated  predicted  success 
rate  for  men  and  women  would  have  been  77%  if  the 
NEO-PI  scores  had  been  used  with  cognitive  aptitude 
scores  in  selecting  persons  to  attend  the  FAA  Academy. 
Overall,  use  of  a  combined  personality-aptitude  selec¬ 
tion  procedure  would  have  resulted  in  net  gain  of  about 
3%  in  predictive  efficiency,  or  approximately  30  addi¬ 
tional  developmental  controllers  (out  of  every  1000) 
being  available  to  the  FAA  for  field  training. 


Fhe  impact  of  that  g.un  of  30  developmental  control 
lets  from  a  sample  of  about  1 ,000  entiy  level  controllers 
may  not  seem  significant  until  placed  in  the  context  ol 
the  relative  costs  to  the  agency.  Fhe  F.A,A  Academy 
•A'l  C'..S  Ntmradar  .Screen  cost  approximately  S 1 0,000  per 
student  to  administer  (Aerospace  Sciences,  Inc.,  lOOl ). 
With  about  2,000  candidates  entering  the  FAA  Acad¬ 
emy  each  year,  reduction  of  the  failure  rate  by  30 
controllers  per  1000  candidates  would  have  resulted  in  a 
savings  of  S600.000  per  year  in  terms  of  wasted  training 
resources.  Fhe  total  savings  over  the  S  full  vears  of  the 
A  1  (,S  Nonrad.tr  Screen's  operational  life  would  have 
been  on  the  order  of  S3  Million  in  saved  training 
resources.  In  other  words,  implementation  /'( an  A  FC.S 
selection  test  procedure  with  just  marginal  improve 
ments  in  validity  would  have  resulted  in  a  significant 
savings  to  the  agency. 

Future  Research  Needs 

The  results  presented  in  this  paper  provide  some  empiri¬ 
cal  counterpoints  to  the  claim  by  Bcsco  (1991)  that 
personality  measurement  in  selection  programs  for  pro¬ 
fessional  performance  lack  both  scientific  and  practical 
value.  Additional  research  is  needed  to  provide  further 
validation  of  these  outcomes.  Differences  between  cn- 
tty-level  controllers  and  the  general  population  norms 
were  found,  with  controllers  being  overall  less  neurotic, 
moreextraverted  and  conscientious.  Entry-level  control¬ 
lers  reported  few  neurotic  symptoms,  appeared  to  ex¬ 
hibit  better  adjustment,  and  tended  to  be  outgoing 
individuals  with  higher  levels  of  excitement-seeking  and 
more  expressive  of  positive  emotions.  This  provides  a 
generally  positive  picture  of  those  who  apply  and  arc 
selected  to  become  operational  controllers,  and  also 
suggests  that  they  are  well  suited  for  handling  the  de¬ 
mands  of  a  highly  responsible  job.  These  differences 
were  in  keeping  with  lay  perceptions  of  the  “controller 
personality.  ”  and  supportive  of  research  that  suggests 
that  certain  occupations  may  attract  individuals  with 
different  personality  characteristics  (Kassera  &  Russo. 
1987).  Additional  research  might  investigate  the  rela¬ 
tionship'  between  per.sonality  and  biodemographic  fac¬ 
tors,  such  as  reasons  for  occupational  choice  and  caicer 
expectations  in  the  controller  occupation. 
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Such  research  could  provide  the  foundation  for  ATCS 
career  guidance  tools  for  use  by  aviation  educators  and 
agency  recruiters. 

I'hc  findings  reported  in  this  paper  demonstrate  that 
personality,  as  represented  by  scores  on  a  theoretically- 
based  and  psychometrically  sound  instrument,  explained 
additional  variance  in  a  technical  performance  measure 
beyond  that  explained  by  cognitive  aptitude.  It  must  be 
noted  that  this  performance  measure  appeared  to  be 
uncontaminated  by  evaluative  biases  noted  by  Besco  as 
fatal  flaws  in  personality-oriented  research.  However, 
further  research  is  needed  to  identify  which  aspects  of  the 
Screen  program  are  most  influenced  by  personality,  such 
as  the  Instructor  Assessment  ofstudent  potential.  While 
the  observed  relationships  w'cre  small,  it  must  be  noted 
that  our  sample  was  a  highly  select  group.  Selection  on 
the  cognitive  aptitude  rating  likely  resulted  in  incidental 
restriction  in  the  range  of  personality  scores.  It  is  prob¬ 
able  that  if  the  group  were  not  initially  selected  on  the 
basis  of  cognitive  abilities,  we  would  see  a  higher  rela¬ 
tionship  between  the  NEO-Pl  scores  and  performance 
in  the  FAA  Academy  A  TCS  Nonradar  Screen.  In  addi¬ 
tion,  further  research  is  warranted  on  the  interaction 
between  personality  and  aptitude  in  performance  to  test 
the  hypothesis  that  certain  personality  attributes  may 
enhance  or  detract  from  performance  for  persons  with 
high  or  low  aptitude  for  the  occupation.  Finally,  longi¬ 
tudinal  research  assessing  the  utility  of  personality  mea¬ 
sures  in  predicting  performance  across  time  is  required. 
It  i.s  likely  that  the  relationships  between  performance 
and  stable  personality  traits  change  over  time.  The  initial 
predictive  power  of  personality  dimensions  may  be  low 
due  to  two  factors:  (a)  variance  in  initial  performance 
may  be  accounted  for  by  ability'  and  prior  experience; 
and  (b)  as  the  “honeymoon”,  characterired  by  initially 
high  commitment  and  effort,  ends  in  a  new  job.  the 
novelty  and  challenge  in  a  job  may  fade  and  dispositional 
fact(.is  may  become  increasingly  important  determi- 
nant.'^  of  performance  (Hclmreich.  .Sawin,  &  Carsrud, 
1 986).  Both  ofthese  factors  may  account,  at  least  in  part, 
for  the  seemingly  low  observed  personality-performance 
relations.  Long-term  follow-up  studies  will  enable  us  to 
investigate  changes  in  the  personality-performance  rela¬ 
tions  within  the  controller  occupation. 
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